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ABSTRACT 


This paper deals with a method of optimizing the free coeffi- 
cients in the characteristic equation of a linear feedback control 
system. The optimization is carried out by minimizing an index 
of performance associated with the system's response to a given 
test disturbance. 

The index of performance is the integral of a quadratic funce- 
tion of the system state variables. The structure of the index 
rests upon a logical interpretation of the regulator nature of the 
control problem. The index for an — order system contains n 
weighting factors whose values are determined from an ac order 
model system. This determination is such that the optimization 
of a completely free system will yield the model system. A syse- 
tem with fewer than n degrees of freedom in the state variable 
feedbacks may be optimized with respect to the free feedback co- 
efficients, yielding a system whose dynamic response to a given 
disturbance is, for this optimization scheme, a best approximation 
to that of the model. 

Examples are presented for illustration of the salient features 
of the method. It is also shown by example that systems with 
closed-loop zeros may be optimized by this method. 

The author wishes to thank Dr. Harold A. Titus for his guid- 


ance in this investigation. 


ii 





i i = = = 
ee se 
=> © Seems 664 > G& ae p —-a~ me 
—a wn la a ae ee 
————i= tee 


ek eee ce a 
t—_  ———emngn at £ di Mn 
er Se — ¢ eee ee | ee Seem 
© ere ree eee ae ae a eet ee 
=a @ ae eee «a 
——— Le ——— a mm Ving 
SO A | Se ee ES aoe 
—_—— + (i) —) =| oe & 
—— ee eel 
—————s_ re oe = al, 
See! s et ee SS 
—eE— SS 

—Stm CO OM) A a te |e 
ee eee eee Be 
© 2? 6 os © <2 a 

—-_ = «§ — a? Ga ae ae 


en me Dc 














Chapter 


III 


IV 


TABLE OF CONTENTS 


INTRODUCTION 


DERIVATION OF THE INDEX OF PERFORMANCE 


ILLUSTRATIVE EXAMPLES 


Example [ 


Example II 


Example III 


DISCUSSION AND CONCLUSION 


A. Stability 
B. Cost Surface Selectivity 
Sensitivity to Plant Parameter 
Variations 
C. Potential Application in 
Adaptive Systems 
D. The Optimum System as a Function 
of Initial Conditions 
APPENDIX 
BIBLIOGRAPHY 


at 


Page 


38 


39 


43 


51 





Figure 


LIST OF ILLUSTRATIONS 


Signal-flow graph for the transfer function 
of equation (1) 


Feedback control system of Example I 
Signal-flow graphs, Example I 

Root locations for Example I 

Transient responses, Example I 

Isometric projection of the cost surface in 


Example I, as a function of the two variables 
a, and a,, for a model system characterized 


by ( = 0.7 and w= 2.0 (a) = 4,0; a, = 2.8) 
Feedback control system of Example II 
Isometric projection of the cost subsurface 


in Example II, as a function of the two var- 
iables a, and a,» for a model system char- 


1 
acterized by a, = 20.0, a, = 18.0, and 
a. = 7.8, and where the actual system is 
constrained by a, = ear 


Root locations for Example II 

Transient responses for Example ITI 
Feedback control system of Example III 
Signal-flow graph of equation (49) 

Pole and zero locations for Example III 
Transient responses for Example III 
Hypothetical curve of optimum gain k as a 


function of plant pole p for the system of 
Figure 2 


iv 


Page 


26 
26 
28 
28 
31 
oy 


36 


@ 
=> ene 
> © 








ets 
55> = 











Figure Page 


16 An adaptive system using a digital com- 38 
puter for surface search and optimization 


17 Initial condition space, second-order 4l 
system 
18 Model poles and optimum pole locus for 42 


the conditions of Example I 


Al Signal-flow graph for equations (A2) 43 
A2 Signal-flow graph for equations (A5) 45 
A3 Signal-flow graph for the Q, P equations 47 


of the fourth-order system 





. >_> 
= =D eeEp a= «¢ 
——>_ 


°° — coo _ ewe ‘ 
' 
nee ee * 

_—_— « . 


= 
——-— —— = oa o 


oem 6 Ga, "—=wy £4 


1 9 on eet 








CHAPTER I 
INTRODUCTION 

The task of designing a feedback control system normally begins 
with a mathematical modeling of the open-loop system, process, or plant 
that is to be controlled. This modeling permits an analytical treat- 
ment whereby the response of the closed-loop system is determined for a 
given test input. This response is very likely, at first, to be unsdtis- 
factory with respect to a given set of specifications; compensation of 
the control system is then indicated. 

Compensation is to some extent a matter of judgement; i.e., the 
choice of a compensation scheme depends upon such factors as cost, 
physical limitations of equipment, availability of certain items of 
information as readable signals, etc., all tempered by the experience 
of the designer. 

It is now assumed that a compensation scheme has been chosen by 
the designer, and that the resulting compensated closed-loop transfer 
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function has no zeros” and may be written 


k 
CLIF = a 29 (1) 


s" a 5" a Ss a 
> n ds , a l 


where the a's and k are functions of the various plant and compensator 
parameters. The signal-flow graph of Figure 1 represents the transfer 


function of equation (1). 


* This restriction will later be relaxed. 
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-a] 
Fig. 1 Signal-flow graph for the 
transfer function of equation (1) 

It is at this point that the designer must translate the given 
time and/or frequency domain specifications into desired root values 
for the characteristic polynomial, or equivalently, the poles of the 
closed-loop transfer function. If all n coefficients in the character- 
istic equation were freely variable, the n poles could conceivably be 
placed at any pre-selected combination of positions. This, of course, 
is rarely the case, since some of the ais contain or represent fixed 
plant parameters. As a rule, one free parameter is required for each 
distinct pole that is to be placed in a pre-selected position, or 
conversely, as many poles may be arbitrarily placed as there are free 
coefficients in the characteristic equation.** Magnitude constraints 
and other physical limitations may further restrict the placement of 
poles to certain regions in the s-plane. 


** A complex conjugate pair may have one or the other of its polar co- 
ordinates (zeta, omega) fixed by one free coefficient. 
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On the ability to pre-select some of the poles of the system rests 
the basis of the dominant mode method of design. The designer uses as 
many free coefficients as are available to place a corresponding number 
of the n poles in pre-selected positions, with the hope that these poles 
so placed will dominate the response of the system to any input. Whether 
or not they are indeed dominant depends upon where the remaining poles 
are found to lie, how they make their presence felt in the time or fre- 
quency domain, and upon the degree of extra-pole interference judged 
to be tolerable by the designer. It is to be noted that the presence 
of closed-loop zeros further complicates the dominance picture, very 
possibly destroying the hoped-for dominance of a carefully placed set 
of poles. 

The dominant mode method places emphasis on a limited number of 
the system's closed-loop poles in the hope that they will dominate the 
System dynamics. It is shown herein that more attention might pro- 
fitably be directed toward placing all the system's poles in such a 
way that no group of poles is necessarily dominant, while all the 
poles collectively give system dynamics closely emulating those of the 
specifications. Such a procedure would start by establishing an ideal 
or model system of the form of Figure 1. This model system would be 
of the same order as the actual system, and the a, coefficients would 
be selected on the basis of the given specifications and their trans- 
lation to suitable pole values. A similar diagram, drawn for the 
actual system, would show some of the feedback coefficients as functions 
of fixed system parameters, the remainder as variable functions of the 
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free plant or compensator parameters. The presence of fixed parameters 
in the actual system effectively constrains the eventual design to cer- 
tain definite regions in the s-plane. The design proceeds by selecting 
values of the variable coefficients in the constrained, actual system 
in such a way that it closely approximates the ideal model in its dy- 
namic behavior in response to a given disturbance. This selection is 
to be made through the mechanism of a cost function, or index of per- 
formance, the fundamental structure of which is based upon intuitive 
judgement and some mathematical requirements. The index is so fash- 
ioned that it contains n undetermined weighting factors, where n is 

the order of the system being considered. To derive an algorithm for 
the determination of these factors for all systems of order n, an 
optimization, or minimization of the index is first carried out in 
such a way that the n weighting factors are forced to be functions 

of the n model feedback coefficients, the a's. 

The actual ach order system is once again considered. The index 
becomes, at this point, a function of some fixed system parameters, 
some variable parameters whose values are to be optimized, the n 
weighting factors whose values are determined by the designer's choice 
of a model system, and the n state variables as they respond to a 
given disturbance. If n parameters in the actual system were free, 
minimization of the index would drive those parameters to the model 
values, giving the desirable result of identical model and actual sys- 
tems. If m (m< n) of the actual coefficients were fixed, minimization 


of the index with respect to the remaining n-m free coefficients would 
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yield a system optimum with respect to an index of performance not en- 
tirely arbitrary, but based in good measure upon the pole locations of 
an ideal model system. In this sense, then, the system so designed is 
a "best" approximation to the model. 

In the literature dealing with the optimum design of linear feed- 
back control systems, much reference is made to arbitarily selected in- 
dices of performance, many of which will either not allow the selection 
of finite values for certain parameters, or will not allow optimization 
with respect to more than one system parameter; e.g., integral square 
error. Furthermore, optimization with respect to such indices often 
seems too much like an end in itself, rather than a means to the end 
of procuring system dynamics that will meet given time and frequency 
domain specifications. 

Some attempts have been made to overcome the deficiencies mentioned 


2 


above. Rekasius”~ has proposed an index based on a model differential 
equation of order less than that of the actual system being designed. 
This approach somewhat restricts the flexibility available to the de- 
signer in constructing a satisfactory model. The present method also 
allows optimization with respect to an index of performance; a single 
measure, to be sure, but one which incorporates such time and frequency 
domain specifications as bandwidth, rise time, and peak overshoot 
through the correlation of model dynamic response to model pole location 
and the dependence of the index's weighting factors on these pole lo- 


cations. Furthermore, the model and actual systems are necessarily of 


the same order. 










—- (4% <4) @ © = =m O~ 
ee | come 
i hen — Ss OO ee 
—— mm OO ee eee & eee 
———— ee ee ee ee * 
@ > ake — 99 -SEi= oe = 
eee 
== (he & 
aT ee --—ae ae *oO™, « 
—_—_—_ —_ — ©. | eae 
——— oe” ~ = em ae! 
CO we Se 6 he See aes 
== 


The chapters that follow will show the main steps in the selection 
of the model-based index of performance and the derivation of the algo- 
rithm by which the n weighting factors are determined. The algebraic 
details of the derivation are given in the appendix. The index is 
generalized for the ie order system with no zeros in the closed-loop 
transfer function. Included are several examples of the use of the 
index in system design, for demonstration of the salient features of 
the method. [It is also shown by example that the index may be used 


in the design of systems including zeros. 
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CHAPTER II 


DERIVATION OF THE INDEX OF PERFORMANCE 


The index of performance, or cost fuNeeLon”, that is to link the 
actual and model system behavior will by choice be a quadratic integral 


functional of the form 


co 
s={ ('Q)x + Tu) at (2) 
O 
where x and u are as shown in Figure 1. A quadratic form is chosen 
simply because it admits of some mathematical treatment that would be 
very difficult if not impossible had another form been chosen. The 


differential equation of the system of Figure 1 may be written in 


vector matrix form as 
X= GX + u (3) 


where G is given by 


0 1 
G = Jus 
NON 
\ ‘“ 
a (4) 
0 
from a eel m<n (5a) 
and ree (5b) 


For convenience, system response will be initiated by initial conditions 
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rather than by external inputs, resulting in a u matrix of the form 


1 7489 ++ eee a 
Equation (3) may now be written 
X= GX + AX 
O x (7) 


The transpose of equation (6) may be substituted into equation 


(2) to give 
j= f | x7(Q, + A’Q,A) x | dt 


Lo) 


Sf xToe at (8) 


Oo 


Except for the form of the oF and Q, matrices, equations (2) through 

(8) completely describe the model system and its associated cost func Cleat 
The evaluation of J for an arbitrary set of initial conditions is 

to be carried out using vector matrix methods. Consider a Liapunov func- 


tion of the systen; 


vix) 2 xT px (9) 


Where P is a positive-definite, symmetric matrix. V(x) possesses the 


2 
following properties , provided the system is stable; 
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a) V(x) >0, x #0 
= 0, x= 0 
“ry — AV(x) 
b) V(x) = | 0, S00 (10) 
= Oj;exaeen0 


c) V(x) + © as [x| —~ © 


d) v(x) ~ 0 as t ~@ 
Differentiation of equation (9) with respect to time yields 
V(x) = x Px + x’ Px (11) 
Using the transpose of equation (7) in equation (11) gives 
v(x) = xl (Fp + PF) x (12) 


To this point, the P matrix and the V(x) function associated with it 


are not defined. This definition is established by 


V(x) x' (FIP + PF) x 








Wr 


x? (-Q) x (13) 


Equation (13) is now integrated as follows: 
=) Leo) T 
[ Vexae = - | x7ox ae (14) 
Oo O 
The right-hand side of the preceeding equation is immediately recog- 
nized as the negative of the cost function, equation (8). Evaluating 


the left-hand side of (14) and substituting limits yields:: 


y= - vix(@) | + v}x(0) | (15) 


For a stable system, x(~) ~ 0, and from the properties given in equations 
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(10), v [0] = 0. Therefore 


y= v |*(0) | = x(0)"P x(0) (16) 


Equation (16) reveals that the cost incurred by the system in response 
to a set of initial conditions is a function only of those initial 
conditions and of the P matrix. The P matrix in turn is a function of 
the system's F matrix and of the Q matrix, as given in equation (13). 
There remains, then, the task of fashioning the Q matrix to fulfill 
the mission set forth in the introduction and above. The following 
requirements, some mathematical and others intuitively logical, are 
to be considered in the selection of the Qv and Qw matrices: 
a) Q must be a square, nxn, symmetric matrix. 
b) Q is to be such that all states are included in J. This is a 
logical consequence of the regulator nature of the problem. 
Since all states are to be driven to zero, they should all 
contribute in some measure to the cost, the subsequent mini- 
mization of which yields an optimum transition to the origin 
of the state space. 
e) Qy and Q, are to be such that together they introduce n 
| weighting factors, whose values will ultimately depend upon 
the n feedback coefficients of the model system, or, equi- 
valently, upon the model poles. 
d) Q is to be such that J includes the “control effort" vari- 
able u. This will act as a constraint to prevent results 


calling for infinite system parameters. It also insures that 
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the optimum control is a linear function of the system 
states“, 
In the light of the requirements stated above, the following con- 


figurations are suggested for the x and Q, matrices: 


2 
nl 
Ry 
Rs 


and (17) 


Q,, = \ 4; A is a sealar 


where a, through a and )} constitute the n weighting factors. These 


combine by equation (8) to give 


2 
1 + ay Aaa, ercccesece- 2,4, 
a ac Se ue:aeenanaaaca es a a 
Aaya) M + ra, Aaa, 
. Rh 
Q= ~ (18) 
[ ~~ 
| = | 
| ~ | 
~ 
) N | 
Aa 8) asveannnaaneaanannaaaacaa a, 4 a 


The P matrix may now be evaluated literally, from equation (13). This 
is done for the second and third-order systems in the appendix, with 
results included for the fourth and fifth-order models as well. The 
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second-order results are presented here for illustration. 
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Equation (16) is now written in scalar form to show the relationship 


between J, the initial conditions, and the elements of the P matrix. 
y= x7(0) p,, + 2p, x,(0) x,(0) + x2(0) p,. (21) 
1 ll 12. =] 2 2 22 


What follows is the key point of the entire derivation. The values 


of Oo and ) must be found so that, for the unconstrained system, the 


minimization of J with respect to a, and aj gives resulting optimum 


values of ay and ao that are, independently of the initial conditions, 
equal to the model values; i.e., it is necessary to find the elements 


a, and \ as functions of the desired coefficients ay and a. so that 
the adjustment of the actual coefficients to the desired values will 


simultaneously minimize the J of equation (21) for any set of initial 
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conditions. 


The measures indicated above are carried out by first taking the 


gradient of J with respect to ay and ay: 








OP OP OP 
Gel aug 11 12 2 22, 
0 x, (0) Sale 2x, (0) x4 (0) 7 x (9) = 0 
1 1 1 
(22) 
oP OP OP 
Oe «2 ue 11 12 2 (oj a 
3a, = x, (0) 3a, “= 2x, (0) x. (0) 3a, * x, (0) Sa, 7 0 


The initial conditions will be assumed to be generally non-zero and 
completely independent. The only possible solution to equations (22) 


must then be of the form 


— il. Oc i, jeden (23) 


eS (24) 
ai 
and 
as = 2a, 
=o (25) 
al 


Similar developments have been carried out for the third and 
fourth-order systems, some details of which are included in the ap- 
pendix. At this point, a recursion formula for the structure of 
the a's in an Age order model was postulated on the basis of second, 
third, and fourth-order model calculations. From this recursion 


formula, equation (26), a prediction was made for the fifth-order 
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case, and was proved correct by extremely lengthy but straightforward 
algebra. This successful prediction of the fifth-order q's has been 


accepted as sufficient proof of the validity of the recursion formula. 


n-1 
l 2 k . 
al a — 2) (= Tega” ae (26) 
1 k=1 
and 

1 
ea 
4) 


where n is the order of the model, andl s isn. By definition, 


a = |] (27) 
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CHAPTER III 


ILLUSTRATIVE EXAMPLES 


EXAMPLE I 


Consider the second-order feedback control system of Figure 2. 
The amplifier gain k is the only variable parameter, and is to be 
selected so that the system's transient response to a given disturbance 
is a best approximation to the model, or desired response. The model 


response has been chosen by the designer as the response characterized 





Fig. 2 Feedback control system of Example I 


by closed-loop roots of damping ratio @ = 0.7 and natural frequency 
Eee 2.0 radians per second. An inspection of the system root locus 
for 0 <= k s » makes it immediately apparent that the ideal root lo- 
cation is unattainable. One may therefore turn to minimization of a 
performance index, as suggested in the previous pages, as a means of 
selecting k. 

The system of Figure 2 is for present purposes best represented 
by the state variable signal-flow graph of Figure 3(a). The model 
system of Figure 3(b) reflects the desired but unattainable char- 


acteristic equation coefficients for the specified root locations. 


15 











—« —— — a oe 





—— es oe l= -— =~ mmm boom 
—~ ——.& © anes 6 —aIS 6 | 
——_—_——_— — _ aaa © pee O6F 
Ei mes ea a " 
— — os ~—te = 


is 


—_ 


——-  — ee gg gm 
—_ «= -_——— ee ce eG seem ml 

2 « —— -— — (ke tom” « 
——_—-_- -— a = — ——_ Sane =a 








Fig. 3 Signal-flow graphs, Example I. 
(a) actual, (b) model. 
From characteristic equation s* 4 a,8 + a) = 0 


For convenience, let the system be disturbed by the initial conditions 
x, (0) = 1.0, x, (0) = 0, and r(t) = 0. The cost function of equation 


(21) then reduces to 
seenO) p.. = 28 
meet? Py een eo) 


where Pay is given, for this second-order system, by equation (19). 
The Q matrix is now to be evaluated. Substituting the model coef- 


ficients, a, = 4.0 and a, = 2.8 into equations (24) and (25) gives 


Zz 
a, = -0.01 
and (29) 
] 
ae 


These values are then substituted in equation (18), yielding 


2 
k k 
Cl+i) 16 
Q= (30) 
k _ 3) 
To (-0.01 + 35 
where a, = k and a, = 1.0 are the actual system coefficients. It is 


1 2 
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to be noted that the model coefficients appear in Q. only through the 
quantities a, and )}. Whenever else in the Q matrix the ais appear, 
they are the actual system coefficients, either fixed and known, or 
functions of the parameters that are to be determined as optimun. 
Equations (19), (28), and (30) combine to give 
eee 


J= -0.00k+ S + = 


1 
; + 5 (31) 


Minimizing J with respect to k gives 


ae wie @ See 
a 0.005 5 + Te 0 (32) 
2k 
Equation (32) has the real solution 
k= 2.03 (33) 


Figure 4 shows the system root locus and compares the model and 
jw 






actual root locations, 


Model ~Ly» 4 
on = 220 = 1.425 
n n 





Fig. 4 Root locations for Example I 


Figure 5 compares the model and actual transient responses, as 


simulated on the analog computer. 
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XN 


Model 


Fig. 5 Transient responses, Example I 


Further insight into the method and means by which the optimum 
value of k was found may be obtained by investigation of the cost 
function associated with two free coefficients in Example I. If both 
coefficients in the characteristic equation are allowed to be free, 


the Q matrix becomes, for the same model values of a, = 4.0 and 


1 
a, = 220, 
oS aa 
l 1 2 
(1+ oe 16 
Qz (34) 
aa ne 
12 t eZ 
a ( 0.01 + te 
The cost function from equations (19), (28), and (34) is now 
a a ae 
2 l l 1 
J=—— - 0.005 4+ So + DD (35) 
2a, a. 2a, 32a. 


Figure 6 is a plot of the surface generated by equation (35). This 
surface is, for the initial conditions of the example, uniquely asso- 
ciated with the values of the model coefficients, a= 4.0 and 
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a, = 2.8, and displays its minimum J . .. at these very values. 
min min 


This is a consequence of the way in which the Q matrix was constructed,,. 
and of the manner in which the weighting factors were derived; com- 
plete freedom to vary all coefficients will always yield the model sys- 
tem. In the case of Example I, where a constraint is placed on one 

of the two coefficients in the form of a, = 1.0, it is not possible to 
drive to the absolute minimum on the cost surface. The constraint is 
equivalent to passing the plane a, = 1.0 through the cost surface. 

The optimum value of a, = k is then that value which achieves a min- 


imum J on the intersection of the plane and surface. From Figure 


in 


6, it is seen that this value is k= 2.03, in agreement with equation 


(33). 
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Fig. 6 [Isometric pro- 


jection of the cost 





surface in Example I, 


as a function of the 
two variables ay and 











for a model sys- 


tem characterized by 


an 




















(a, = 4.0, = == Zao) 

















EXAMPLE II 


The third-order feedback control system of Figure 7 is to be 


compensated using rate feedback as shown. The gains h and k are 





Fig. 7 Feedback control system of Example IIL 


to be. selected so that the system is optimum with respect to a model 
having a complex conjugate root pair with wae 2.0 radians per sec- 
ond and © = 0.7, and the third root at s = -5.0. Inspection shows 
that the model poles have been placed in a region of the s plane made 
unattainable by the constraints of the compensation scheme chosen. 


The model root locations correspond to the characteristic equation 


6° 4 7.85> + 18st = 0 (36) 


The actual system is characterized by the equation 
3 Z 
s + 2s + (h+ l)s a k= 0 (37) 


Equation (37) shows that 2 in the actual system is constrained to 
the value 2.0, and that there exists complete freedom to vary the 
ay and a, coefficients. 
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To show the single cost surface associated with three degrees 
of coefficient freedom is, of course, graphically impossible. The 
constraint a, = 2.0, however, is effectively a plane which intersects 
the hypersurface in such a way as to yield a subsurface dependent 


upon a, and a, alone, and hence graphically representable. Equi- 


valently, a family of surfaces giving J as a function of ay and a, 


with a., the family parameter could be drawn. The surface corres- 


ponding to a, = 7.8 would display the absolute minimum of all sur- 
faces, while the surface drawn for a, = 2.0 would display a minimum 


greater than the absolute minimum, and would yield the optimum values 


of ay and a, and hence of h and k. Figure 8 is a plot of the sub- 


surface for a, = 2.0, the equation for which is derived below. 


From the recursion formula (26), for the third-order model 


with a, = 7.8, a, = 18.0, and ons 20.0, 





5 y mia 
a’ -2a.a 
shee imo. 12 
a9 -> = 400 
S 
1 
a’ -2a 
Ene 2 24.8 (38) 
37 D ~ 400 
a 
1 
l 
A = 00 


ate 
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Fig. 8 Isometric pro- 
jection of the cost sub- 
surface in Example II, 
as a function of the two 
variables ay and ay» for 


a model system character- 
ized by a, = 20.0, 
a 


2 = 18.0, and a, = 7.8, 


and where the actual sys- 
tem is constrained by 
a = 220% 


io, 2 
‘ Ss, os ed 

ee 
weet 


(6.3 ,7.9) 


a; 


Zo 





From equation (18), the Q matrix is 





a’ a.a 2a 
1 172 1 
(1+ 75? G00 00 
4135 12 a, 2a, 
Q= %00 00 + Z00 > = G00 EX, 
- Mp aha, 6, 
400 400 400 * a 





Again for convenience, the system will be disturbed by an initial 


unit displacement only, in which case 


2 = 
J = x, (O)P1) =Py4 (40) 


From the appendix, Py for the third-order system is given by 


=) =2 a ag 
Pl sesh LZ, - 2(ayaq -8)) ] =diige top La a, -4)) : 


Suis Poon ana, + 933 — 3 4) | (41) 
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From equations (39), (40), and (41), with a, = 2.0, 


3 
2 3 2 
800 a, -400 aia, + aia, +. 24a, + 
3 
24.8 a) + 1600 ay 





(42) 
2a, (2a, -a,) 


By far the most reasonable method of finding a, and a, for 


1 


Jig in equation (42) is by surface search techniques using a gen- 


eral-purpose digital computer. In this case the search was con- 
ducted by incrementing the parameters ay and ao about an initial 
point, testing for the maximum decrement in J, establishing a new 


initial point, and repeating the process until the minimum was lo- 


cated. J . was found to lie at 
min 


“il = 6.3 
(43) 
a, = 729 
giving optimum gain settings, by equation (37), of 
k= 6.3 
(44) 
h= 6.9 


Figure 9 compares the model and actual root locations, while 


Figure 10 compares the transient responses. 
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“5, -1.4 4 j1.43 
Fig. 9 Root locations for Example II 


"g Model 


eecasi 


Fig. 10 Transient responses for Example II 
It is of interest to note that the dominant mode method dis- 
cussed in Chapter I, if applied to Example II, yields a peculiar re- 
sult. Since two coefficients are independently free, it is reason- 
able to expect that a pair of complex conjugate roots may be exactly 


placed. No control is possible over the position of the third, real 
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root, p. If the conjugate pair is placed at Gen 0.7, w= 2-0, 
2 
(s + 2.88 + 4)(s + p) = 0 (45) 


which upon multiplication becomes 


5? + s7(2.8 + Pp) + 8(2.8p + 4) + 4p = 0 (46) 


Equation (46) is to be compared, with respect to coefficients of like 


powers of s, to the actual system equation 
3 2 
8S + 2s + (h+1)s4+k=#= 0 (47) 


such a comparison shows 


P= -0.8 
k= -3.2 (48) 
h= 0.76 


The resulting system is obviously unstable. 
EXAMPLE III 


A feedback control system with a zero in its closed-loop transfer 
function does not fit the classification established by Figure l. It 
will now be shown, however, that zeros may be accounted for by intro- 
duction of forward, non-looping paths from appropriate state vari- 
ables in the signal-flow graph of Figure 13 and that the method of 
optimization employed in the previous examples may again be used with- 
out modification. 

The closed-loop transfer function of the system in Figure 11 may 


be written 
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le ck 
r =| 


s k 
3 2 
s+ s (p+1)+ s(p +k) + kz 





(8 + 2) (49) 


which displays a closed-loop zero at $s = =z. 


The signal-flow graph 


a k (s +z) 1 c 


7 (s + p) s(s + 1) 


Fig. 11 Feedback control system of Example LII 


of equation (49) is shown in Figure 12. Ome notes that all the closed- 


ee 


— — 1 





i 
S 


Fig. 12 Signal-flow graph of equation (49) 
loop pole information is contained within the dotted line enclosing 
the feedback portions of the graph, and that this part of the graph 


is consistent with the form of Figure 1. From equation (49), 


28 





c= (8 + Z)X) (50) 

Equation (50) describes the feed-forward paths necessary to make up 
the output, c, and also accounts for the closed-loop zero. 

The design objectives of this example may be stated by selecting 
model valuesfor the three poles and one zero. The values of k, z, 
and p are then to be selected so that the resulting system is optimum 
with respect to this model. [It should be noted that at first inspection, 
three parameters are independently variable, and that one could con- 
ceivable place the three closed-loop poles precisely where they were 
wanted and let the zero fall where it may. This, however, is not in 
keeping with the idea of driving a constrained actual system as close 
as possible toward a model whose respective pole and zero locations 
are considered ideal, and which has the same number of poles and zeros 
as the actual system. 

The model poles are specified as a pair with OS 2.008 = 077; 
and a real pole at s = -5.0. The model zero will be placed at s= -2.0. 
One now observes that the zero of the actual system may be made to 
coincide exactly with the model zero simply by setting z= 2.0. This 
is an arbitrary choice but a necessary one, since the present method 
optimizes a response on the basis of pole location alone. There re- 
mains, then, the task of placing the three system poles so as to be 
optimum with respect to the model poles, using the two free parameters 
k and p. Because the zero has been dealt with and disposed of, only 


that part of Figure 12 lying within the dotted line is yet to be 


29 


—- § =e -_ 

Ga, 6 «e _— —- 
a — a = 
HS -« > se —_ 
——- ® . =——= 6 —@ 

















— _ —- -——e a «€ © ——— © a. arr 


=— <= « ————_— — — «= —ae - ld Ma 
= (i —-« = —_ — § oe . 2 => <-> Sa 
_——— —_— = | a —— ted tf 


iieams oa <> © Cee to oC - 
= =—_ == & ce 

* _ ~ Mm —  —eEzz-— eee aaa 
i=-=—iter — Se & > inert ee 
—_—ce ee <a al — o—- << 


” « —,. 
@ © oe =e '_—_ 


—_— t=eneme ie ene = eo @& Gaps -y, 
=e « we «© aa!) eee ,° =e se =: 


determined. It is for this configuration that the optimization meth- 
od of Chapters I and II has been derived. 


With z= 2.0, the closed-loop transfer function becomes 


k(s 2 


H io 


3 2 0 
s +s (p+ 1) + 5(p + k) + 2k 


Because the model pole locations of this example are identical to those 
of Example II, A,» Aa» and ) are given by equations (38). Following 
the same steps as those taken between equations (39) and (42) of Ex- 


ample II, one finds 


2 3 3 4 
J= “352k + 8k p + 230.4k) + 800k 4 8k (52) 


1600k(p* + kp + p-k) 


- 4 16Gblep- yusGeK-@ ser00ne 4. oe 


Minimization of (52) with respect to k and p was carried out by surface 


search techniques and yielded the values 


k = 10.8 
¥ (53) 
p= 8. 


The cost J could have been expressed in terms of the ay coeffi- 


cients rather than k and p, in which case 


ay = 2k 
ao = p¢+k (54) 
a,=a,- a,/2 eae | 


The minimization would then have been carried out with respect to ay 


and a, rather than k and p. Algebraic solution for k and p would then 
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follow by equations (54). 
Figure 13 compares model and actual pole and zero locations, 


while Figure 14 compares transient responses, 


jw 





Q& Model : s= <5, -1.4+j1.43 

() Actual: s = -6.6, -1.16+j1.37 

© Zero identical for model and 
actual systems, by choice. 


Fig. 13 Pole and zero locations for Example III 


ra Actual 


Model 


Fig. 14 Transient responses for Example III 
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It must be emphasized that the solution obtained above is not un- 
ique, since a different set of optimum parameters would have emerged 
had another value been selected in the free choice of the zero loca- 
tion. Furthermore, many such solutions would very likely show that 
among those many optimum systems there is one that is "most optimum" 
in terms of cost, J. Indeed, this solution would be the one first men- 
tioned in this example, in which the three poles assume their model 


values, giving the absolute minimum cost, J Doubts might be 


min min’ 
cast on the acceptability of such an “optimum optimum", however, if 

the zero turned out to be far removed from the model zero, for the 

cost function J does not penalize the output of the system of Figure 

12, and acknowledges the presence of the zero only insofar as it affects 
the closed-loop poles. For this reason, it is suggested that whenever 
free zeros are introduced, as for example by cascade compensation, 

these zeros be placed at or near the model zero values for a first 


solution. The results of Example III indicate that this approach can 


yield very satisfactory results. 


oy. 


CHAPTER IV 


DISCUSSION AND CONCLUSION 


A. STABILITY 

The question of stability must be discussed in connection with 
any method of control system design. The method of the previous chap- 
ters will consistently yield a stable optimized system if a few 
straightforward guide-lines are followed in setting up any particular 
design problem. 

The first requirement is that the model system be stable. This 
insures that there will exist a multi-dimensional cost surface, posi- 
tive in a region surrounding the model parameter values, and exhibiting 
a minimum at these model values. The region of stability for the model 
cost surface has bounds determined only by the order of the system. 

The stable region for the surface of Figure 6, for example, is defined 
by a, > 0, a, > 0. For the total surface of Example II, of which 
Figure 8 is a subsurface, the stability region would be defined by 


>e0, a, > OF & >80,%a 


aa, - a) 1 9 3 
both by the Routh criterion and by equation (41). 


> 0, a fact which is made evident 


The designer will normally choose a compensation scheme that 
provides a good measure of feedback from plant variables, simply be- 
cause these variables contain information about the more basic but un- 
available state variables. He may also choose to approximate the 
state variables by the use of various filter networks. In any event, 
it is more likely that the final choice of compensation will at least 
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allow absolute stability. Any concern with stability is now ended, 

for the optimization process that follows stabilization cannot possibly 
render the system unstable. The fact that the system can be stable 
indicates that the real system's constraints on the coefficients of 

the characteristic equation are such that the cost subsurface gen- 
erated by the constraints lies within the stable region of the model 
surface, and exhibits its minimum therein. Figure 8 shows just such 


a subsurface generated by a constraint a, = 2.0 in Example II. It 


5 


should be noted that there is now a secondary stability region ack- 


nowledging the constraint, and defined by 2a, - a) 20. ay 


In searching the subsurface for its minimum and hence the optimum 


> 0, a. > 0. 


values for ay and ay, care must be taken that the search begin at a 
point known to be within the stable region. 

In summary, stability is handled by any of the conventional methods. 
By applying them, the designer insures that the compensated system can 
be stable. The stability region for the constrained surface (Ssub- 


surface) is determined, and the search of the subsurface proceeds from 


a point known to be in the stable region. 


B. COST SURFACE SELECTIVITY 
SENSITIVITY TO PLANT PARAMETER VARIATIONS 


The term selectivity will be associated with the slope of the 
cost subsurface in the neighborhood of its minimum, or optimum point. 
High selectivity will indicate a relatively sharp minimum; low selecti- 
vity, a shallow minimum. Low selectivity in a cost function can be 


somewhat undesirable in certain contexts. Let it be assumed, for 
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example, that a system is being adaptively optimized with respect to 

a certain integral index of performance, and that the index, or cost, 
is being evaluated by actual integration of the appropriate functions 
of the system's state variables as they respond to a perturbation. 

It is further assumed that the state variables called for in the in- 
dex are available and measurable. As soon aS measurement enters the 
problem, measurement errors inevitably follow. It is easily seen that 
small errors in cost evaluation can bring about relatively large errors 
in the optimum parameter settings for the case in which the cost sub- 
surface near the true minimum is inherently shallow. 

The design method of this paper, however, does not in any way 
rely upon the measurement of dynamic variables, and is to that extent 
free of low selectivity shortcomings. Given that a cost subsurface 
has a true minimum, that minimum can be located with as much accuracy 
as computing machines will allow, be the minimum shallow or sharp. 

Measurement errors of another kind do find their way into the 
present method via the identification of the plant's configuration 
and fixed parameters. The term sensitivity shall be employed to 
describe the relationship between a small change or error in a 
given fixed plant parameter and the corresponding displacement of 
the cost subsurface and its true minimum. A high sensitivity would 
indicate that relatively greater care would need be taken in de- 
termining the fixed constants of the plant being controlled. 

Sensitivity may be dealt with quantitatively, as will now be 


shown using Example I for illustration. Let the open-loop plant 
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pole in Figure 2 of Example I take on all values on the negative real 


axis; i.e., if the pole factor is designated as (s + p), 
O0O< p<o (55) 


Assume that the optimum value of k has been determined for enough 


values of p to establish the hypothetical curve of Figure 15. The 


k 
opt. 


2.03 





1.0 
Fig. 15 Hypothetical curve of optimum 
gain k as a function of plant pole p for 
the system of Figure 2 


sensitivity of the optimized parameter k to changes in the plant pole 
p is defined as 


dk 
kp dp ey) 


S 
of simply the slope of the k versus p curve. 


The cost function of equation (31) may be rewritten to include 


the plant pole literally, as follows: 


2 
_ Pp. kK laa 
J= 3 0.005 Bt > 3p (57) 


Optimization is carried out with respect to k, giving 


AJ 0.005 _P_ k 
—— = 3 + ~~ = 0 (58) 
3 Pp 9.2  %LoP 


Equation (58) may be solved to give the optimum k for any plant pole 
p, for the model system selected in Example I, a = 2.0; C= 0.7. It 
may also be differentiated with respect to p to yield the sensitivity 


of the optimum gain to changes in the plant pole p. From equation 


(58), 
Boron” Sap” eo (59) 
and 
dk 2 dk 
-0.16k 5 -16p + 3k” SE = 0 (60) 
from which 
& = —1oPR __ (61) 


ame Coweta: 
Substituting the values p= 1.0 and k = 2.03 from Example I, gives 


dk 
Sip = ap = 1-33 (62) 


Thus there has been added to the coordinates of a single point on the 
curve of Figure 15 the slope at which the curve passes through that 
point. Although no further information about the curve has been de- 
duced, this figure for sensitivity gives assurance that small changes 
in the plant pole about the value p= 1.0 would not call for drastic 
changes in the optimum forward gain setting, and that no violent de- 
parture from optimum response will be observed if the gain setting is 
left at a single constant value. 
It is believed that the sensitivity problem as described above 


presents a potentially fruitful area for further investigation. 
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C. POTENTIAL APPLICATION IN ADAPTIVE SYSTEMS 

The examples in Chapter III deal with linear, time-invariant 
plants and the selection of compensator parameters to optimize per- 
formance relative to a model. The design is carried out but once, 
and remains valid as long as the plant remains unchanged. Should 
the plant constants change for any reason, the design becomes invalid 
in the strict sense of optimality with respect to the model. The ex- 
tent to which plant parameter variations may be troublesome is in 
part a function of the sensitivity associated with each parameter. 
The effect of the variations can be counteracted by effectively re- 
designing the system constantly, or as often as new information about 
the changing plant parameter is made available. Thus the system 
would be adapting to changing conditions by continuous optimization. 


Figure 16 shows a suggested functional block diagram of such an 


—— oe 


eet Compensator Plant 


Out put 


Fig. 16 An adaptive system using a digital computer 
for surface search and optimization. 


38 


















—_-> «—§ — Ee aa Ss ea! 


PS -_ CP —_z: mae 


— —e —— ———  « 
- - o—— PEP Ese, (eee 

= ——— —= eal = * gee” ih te @omme 
ee ~~ sn 6 - = —— =e fet toe ee pp 
°°” => = =? © SE —S|  ———_ «6h eS © 


ee 
———-_ew ss (se Osea e@ «¢ » ame 1) 6 amy 
—— t———~€,© tn  — m— n—_ © aa?’ 
(0  ~__hs+nwm=-—@’- aaa” © Ars 
PhO 2@ eS sp ey ST ee @! 
_ * = = © ee tg «ote 
8 6 re me tees emt ¢ ee a) ele 


adaptive system. It is assumed that a satisfactory scheme of plant 
parameter identification is available. Information from the identifier 
is sent to a special purpose digital computer, into which has been 
programmed all the information necessary for the continual construction, 
search, and minimization of the cost subsurface appropriate to the 
plant, the compensator configuration, and to the model system. Optimum 
control parameter settings are then continually updated as the identi- 
fier and digital computer monitor the operation of the system. 

Some further dividends are potentially available in the adaptive 
system outlined above. Many identification schemes require as much 
information as possible about the system's state variables; i.e., the 
System output and its successive derivatives. These variables are not 
often available, especially in higher-order systems. Identification 
then requires that some knowledge of some, if not all, of the state 
variables be gained by approximation techniques. As long as some of 
the higher derivatives are being approximated for use in identification, 
they might just as well simultaneously be used as feedback signals, en- 
abling greater conformation of the actual system dynamics to those of 
the model. In the very unlikely case that all the state variables 
could be accurately approximated, the design procedure of this paper 
ig not needed, nor for that matter is any other, since complete free- 


dom would then exist for the placement of all system poles. 
D. THE OPTIMUM SYSTEM AS A FUNCTION OF INITIAL CONDITIONS 


The illustrative examples of Chapter III are all based upon an 
initial condition of displacement (x, (0) # 0) only. This type of 
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disturbance was chosen because of its equivalence to a step input for 
a system with unity feedback in the outermost loop. This conforms to 
the wide use of the step as a test input in control system design. 

It should be noted that the admission of non-zero values for the 
higher-order initial states will, for constrained systems, give rise 
to optimum free parameters that vary as functions of the direction of 
the initial condition vector in the initial condition vector space. 
This may be illustrated by referring to the cost associated with a 
second-order system, as a function of the initial conditions and the 


elements of the P matrix. This was given in equation (21) as 


J = xy (0) p,, + 2x, (0) x, (0) Py, + x50) Py, “a 


It is obvious from equation (63) that at least the shape of the total 
cost surface is a function of the initial conditions, and that the 
subsurfaces and their associated local minima generated by the actual 
system constraints will move about with changing initial conditions. 
It must be observed, however, that the minimum of the total cost sur- 
face is unalterably and securely tied to those coordinates specified 
by the coefficients of the model system. Equations (22) and (23) 
guarantee that the iy * share a common minimum independent of the 
initial conditions, and similarly guarantee that any linear combination 
of the ee such as equation (63), also displays that same minimum. 
A completely free system, then, will always optimize at the model 
values. A system so constrained that the model poles are unattain- 
able but relatively close to the attainable region will yield a 
narrow range of optimum solutions as initial conditions are changed. 
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It is not necessary to exhaust all points in the initial condition 
Space to observe the aie Sees of the optimum poles as a function of the 
initial conditions. Figure 17 shows the initial condition space for a 
second-order system. Point "1" is located on a unit circle centered 


at the origin. Point "2" shares a radial line with "1", and lies at a 


‘ 


x, (9) 





Fig. 17 Initial condition space, second-order system 


radial distance d from the origin. It can be shown by simple sub- 
Stitution in equation (63) that the costs associated with points 

"1" and "2" differ only by the constant (a7), This means that only 
the unit circle in the x, (0); x, (0) plane need be investigated. 
Points on this unit circle may be "mapped" onto the s-plane by de- 
termining the optimum pole locations for the constrained system cor- 
responding to all points on that circle. The result will be a locus 
or region of optimum root locations for all possible initial condi- 
tions. The size and extent of the region, it is felt, will in large 
measure be dependent upon the proximity of the model poles to phy- 
sically realizable pole locations. Such a region is shown in Figure 
18, drawn for Example I. The end points of the optimum locus are 


not determined. 
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Z\ Model poles 


--- Physically realizable 
root locus 


Boxes enclose optimum 
portions of the locus 


Fig. 18 Model poles and optimum pole 
locus for the conditions of Example I 


It is felt that further investigation of these optimum regions pre- 


sents a possible avenue for future research, 
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APPENDIX 


I Solution for the P matrix from equation (13) 


1) Second-order system 





From equation (13), | 
=%1; “> os Pig Pa 
Z = “ 
491 192 B 2 - Poy Poa 
. (Al) 


where P and Q are symmetric matrices. Matrix multiplication yields 

sane (Pj 9 

Pir #2?12 wege22 G2) 
“499 = 2P19 ~289P9 

Equations (A2) may be graphed as shown in Figure Al. 


441 412 492 





Pio 


Fig. Al Signal-flow graph for equations (A2) 


The elements of the P matrix may be written directly from the graph, 


using Mason's gain formula. 
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7 2 1 l 
Pee 42 7 2a, 931 +. 99 “TT Be. 2p 
2 2 
q 
mat 
Pip = Pee we) 
1 
- e 499 4 441 
22 2a, 2a, a, 


2) Third-order system 


From equation (13), 





en) ~ 113) P11 wee Pio P13 
"72 43gi(hor PD Po2 Po3 
9432 433) 1P31 P32 P39 P33 

| (A4) yi 


The nine scalar equations resulting from matrix multiplication in eque- 
ation (A4) may be reduced to six by symmetry. They are 

"ee | nei 

319" 91 “7 2P mee 23 

*Mige> Pi 2ueePigmeaiies 

“Inq = 2P12 ~249P33 7) 

“9193 HP22 8gPo3 emPige “was 

“433 = 2P23 ~243P53 


These equations are graphed in Figure A2. 


~~ eee aa 








Fig. A2 Signal-flow graph for equations (A5) 


Application of Mason's gain formula yields 


2 


“2280 3 _ 


9, a3 
Pay * 41 Gr us 5) “V9 + “Sp 





ei mene SS a 
P53 2a,D + "2D D 2D 
2 
_ . 413%9"3 . 33g? alles 
Pio = D 2D 2a,D 
, SMa, 222 eae 
P33 = 2a,D ~ 2D D * 2D 
‘ 2 otae sae ; 
Pog ™ “493 * 411 2a,D 2a, 
2 
113 (45 + a,) Io9 (4, + a3) 
D 2D 
D = @aea 
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2 
qigra 3 A aga" 4 
D 2D 
q 
hei 
2D (A6) 


3) Fourth-order system 
Manipulation of equation (13) for the fourth-order system yields ten 
equations, whose graph is shown in Figure A3. The elements of the 
P matrix may again be written directly, using Mason's gain formula. 


Only Pay is given here because of space limitations. 


2 
7 e Be 23 tt) = 93364142 7839344? 
rile “Tl \ 2an 2D Tie D 


2 2 
91996919555 871%) ton Geren? 3 ane 
2D * D 2D 


+ pe (A7) 


4) Fifth-order system 


From equation (13), using signal-flow graphing, (not shown) 
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; a,a. +a a“ Lng 
le 2” 5 l 4 1 3 l*5 
#(-419) + 44, ( wets A iista's Ths as * = ) 


(A8) 


aa a. -a 
Li Zea 


ee a ay mr Wis. 3D 
+444 2D ° 55 


2 2 
"aa "a, + 2a,a a. + a,a.a 


‘ 2 2 2 
= Ieee Oy Ges 5 ee. 3 S57 lear, 


II Derivation of the q's and ) 
1) Second-order system 
OP, 


From sal = 0: i, j= 152 (A9) 


and Q as given in equation (18), six equations are obtained, only 


two of which are independent or non-trivial. They are 


and 





=F (A10) 
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from which 9 


a 2a, 
Oy = © (All) 
1 
2) Third-order system 
From 

OP, . 

== 0; lens 3 (A12) 
n 


i, j as in equations (A6) 
and Q as given in equation (18), eighteen equations are obtained, only 


three of which are independent or non-trivial. They are 
1 
X= 77 
a 
1 


a7a “a ae a’ ae + 2a,a, = 0 
yo mees 9993 6 See a = 
(A13) 


oe + a a 2a,a, + "ee ane a, = 0 
jeeoreeget “Foe “alge 9 3 a 
The last two of equations (Al13) may be solved for the q's to give 


2 
a, o2a,a, 


oe 2 
5 (Al4) 


oe 


3) Fourth-order system 
Similar procedures applied to the fourth-order system yield four ine 


dependent equations, whose solutions are 
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(A15) 


4) Fifth-order system 


The fifth-order system yields the following solutions; 


(A16) 
2 
a. ~2a,a, 4} 2a as 


=) ee ee 


2 
ay, -2a,4, + 2a, 
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